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COMBAT-READY  CREW  PERFORMANCE 


MEASUREMENT  SYSTEM  STUDY 


I . INTRODUCTION 


Research  for  the  improvement  of  combat-crew  training,  and 
the  efficient  execution  of  current  training  programs,  are 
heavily  dependent  upon  good  sources  of  information  about 
trainee  performance  during  and  at  the  end  of  training.  In  an 
effort  to  improve  training  performance  information,  this  study 
is  directed  to  systematic  definition  of  performance  and 
development  of  methods  for  measurement. 

The  point  of  view  taken  in  this  study  is  that  measurement 
is  the  means  of  providing  information  needed  by  training 
research  scientists  and  operational  training  personnel.  The 
primary  goal  of  this  study  is  to  provide  usable  measurement 
tools  for  attacking  problems  related  to  combat-crew  training. 

In  accordance  with  the  initial  definition  of  this  study, 
emphasis  was  placed  on  pilot  performance,  but  it  was  soon 
recognized  that  avoiding  the  performance  contributions  of 
other  crewmembers,  and  the  interaction  between  crewmembers, 
had  more  serious  consequences  than  desired.  To  correct  this 
problem,  additional  tasks  were  undertaken;  in  particular, 
additional  data  collection  visits  were  made.  The  original 
efforts  included  visits  related  to  A-7,  F-4,  F-106,  B-52, 

C-141,  C-130  combat-crew  training  units.  The  current  effort 
involved  follow-up  analyses  on  the  F-4E  and  C-141A  to  provide 
additional  data  on  fighter  and  heavy-multi-engine  aircraft. 

The  original  study  consisted  of  three  basic  phases:  an 

analysis  of  measurement  requirements  (Phase  I) , a conceptual 
design  (Phase  II) , and  design/specification  studies  (Phase 
III).  The  third  phase  now  contains  four  sub-parts:  IIIA. 

Crew  Performance  Measurement;  IIIB.  Air  Combat  Maneuvers 
Measurement;  IIIC.  Design  Studies;  and  HID.  Specifications, 

This  report  presents  the  findings  of  the  Phase  IIIA 
effort.  The  program  structure  and  the  relation  of  this 
effort  is  presented  in  the  following  paragraphs.  The  second 
chapter  presents  results  related  to  the  C-141A;  the  third, 
results  related  to  the  F-4E.  The  fourth  chapter  discusses 
specific  measurement  system  and  data  processing  problems. 

Lastly,  a summary  is  given  in  Chapter  v. 

Program  Structure 

This  contract  is  an  application  of  the  systems  approach 
to  the  design  of  a measurement  system  to  produce  information 
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relevant  to  combat-crew  training.  Consequently,  the  initial 
program  phase  is  devoted  to  a definition  of  the  requirements 
appropriate  to  such  a measurement  system.  It  is  intended  to 
establish  the  requirements  by  determining  the  information 
useful  and  meaningful  for  combat-crew  training,  and  the 
requirements  imposed  by  anticipated  research  topics. 

The  program  was  structured  to  move  rapidly  through  six 
major  activities  shown  in  Figure  1.  Starting  with  a defini- 
tion of  requirements  for  pilot  proficiency  measurement,  a 
conceptual  design  study  leads  to  design  studies  (four  months) 
and  finally  specifications  for  a hardware/software  measurement 
system  and  the  final  report. 

After  the  requirements  for  pilot  proficiency  measurement 
were  established,  a short  period  of  time  was  given  to  the 
consideration  of  the  variety  of  possible  systems  and  to  the 
constraints  imposed.  A conceptual  design,  consisting  of 
feasible  alternatives  has  been  formulated  to  indicate  the  type 
of  information  possible,  the  places  where  such  information 
would  be  useful,  and  the  possible  ways  such  information  can  be 
collected . 

In  addition  to  a conceptual  design,  it  was  concluded  that 
the  measurement  of  crew/system  performance  (as  opposed  to 
pilot  only)  was  quite  important  to  a thorough  description  of 
performance  for  certain  tasks  and  missions.  Consequently,  it 
was  decided  to  undertake  an  additional  task  to  define  crew 
proficiency  measurement  requirements  and  incorporate  these 
requirements  into  the  conceptual  design.  Once  defined,  the 
resulting  alternatives  will  be  presented  at  a decision  point 
meeting. 

Based  on  the  direction  received  at  that  meeting,  alterna- 
tives will  be  analyzed  to  further  define  the  details  of 
implementation,  and  the  nature  of  the  tradeoffs  to  be 
considered  in  the  selection  of  desired  measurement  systems. 

It  is  apparent  that  the  variety  of  problems  presented  by  the 
spectrum  of  Air  Force  combat-crew  training  may  lead  to  a 
number  of  possible  measurement  systems.  It  is  hoped  that  some 
commonality  will  be  found,  and  that  priority  applications  can 
be  defined  to  allow  detailed  analysis  of  the  benefits  and 
costs  of  a measurement  system  with  broad  application.  It  is 
understood  that  to  be  "usable"  a measurement  system  will  have 
to  be  quite  inexpensive  in  comparison  with  the  benefits  to 
training  which  will  be  derived. 

A last  decision-point  meeting  will  be  held  to  determine, 
based  on  the  analysis  performed,  a specific  system  most 
directly  useful  as  a research  tool.  For  this  system, 
specifications  will  be  prepared  to  define  the  system  in 
sufficient  detail  to  implement  the  system.  The  specifications 
will  include  hardware  descriptions,  measurement  definitions 
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and  other  software,  data  handling  equipment,  procedures  and 
personnel.  In  short,  the  total  measurement  system  will  be 
defined.  It  is  assumed,  however,  that  such  a measurement 
system  will  initially  be  configured  for  test  and  experimenta- 
tion with  the  system  prior  to  any  major  use  of  the.  measurement 
system  for  training  applications. 

The  basic  problem  was  to  tl  oroughly  define  the  require- 
ments for  a measurement  system  to  sense  crew  interaction.  To 
do  this,  a survey  was  conducted  at  those  places  where  the 
information  is  available.  Table  1 indicates  the  sites  that 
have  been  visited. 


TABLE  I 

REQUIREMENTS  ANALYSIS 
COMBAT  CREW  TRAINING 


> 

1 

Luke  AFB 

F-4 

Davis-Monthan  AFB 

F-106 

Tyndall  AFB 

B-52 

Castle  AFB 

C- 141 

Alt us  AFB 

C-130 

Dyess  AFB 

*F-4E 

George  AFB 

*C- 141 

Norton  AFB 

ACM 

Nellis  AFB 

*Vis.ited  specifically  for  the  collection  of 
information  on  crew  performance. 


l 4 LA  CREW  PERFORMANCE  MEASUREMENT 


The  c-l-ia  i.s  a versatile  airlift  aircraft  capable  of  a 
'umber  of  lypes  of  missions;  however,  these  are  generally 
divided  into  two  categories:  an  airlift  mission  and  a combat 

airli ft  mission.  The  airlift  mission  involves  transport  of 
cargo  or  personnel  on  a global  scale,  between  improved  runways. 
The  combat  airlift  mission  involves  flight  at  low  levels  and 
air  drop  of  cargo  or  personnel  with  precision  over  a drop  zone, 
which  may  have  only  recently  been  manned  by  advance  troops. 

The  combat  airlift  mission  is  accomplished  by  numbers  of 
aircraft  flown  in  formation,  guided  by  the  lead  aircraft. 

The  crew  composition  is  basically  the  same  for  both 
missions,  consisting  of  a Pilot,  Copilot,  Navigator,  two 
Engineers,  and  two  Loadmasters.  The  lead  aircraft  in  the 
combat  airlift  mission  carries  two  navigators.  The  Military 
Airlift  Command  practices  standardization  of  crewmembers  so 
that  any  selection  of  qualified  personnel  from  the  manpower 
pool  should  be  able  to  accomplish  a mission.  Thus,  crews  are 
not  trained  together,  standardization  is  expected  to  provide 
required  crew  interaction.  For  the  standard  airlift  mission, 
this  procedure  apparently  works  well,  but  for  the  combat 
airlift  mission  an  intense  degree  of  teamwork  is  necessary, 
requiring  some  training  as  complete  crews.  In  particular, 
the  lead  crew  trains  together  extensively,  and  each  squadron 
has  a Select  Lead  Crew  (their  best  crewmembers)  who  are  used 
for  special  missions. 

Airlift  Mission 


The  elements  of  the  Airlift  Mission  are  listed  in  Table 
II.  Takeoff,  Climb,  SID,  Descent,  Approach,  and  Land  have 
been  previously  described1.  The  standard  mission  from  Norton 
AFB  is  over  water  to  Hawaii,  Alaska,  Japan,  Korea,  Southeast 
Asia,  etc.  The  principal  difference  between  such  flights  and 
CONUS  flights,  is,  of  course,  the  nature  of  navigation 
required.  Little  time  is  spent  in  an  airways  and  TACAN 
environment,  most  of  the  time  is  spent  navigating  through 
inertial,  celestial,  Loran,  and  Consolan  means.  The  navigator 
flies  the  airplane  through  the  computer  and  autopilot  most  of 
the  time.  The  loading  and  unloading  phases  emphasize  the 
services  of  the  Loadmasters;  however,  the  tasks  are  procedural 
and  the  major  crew  interaction  lies  in  determination  of  a few 
items  such  as  the  gross  weight  and  the  C.G. 


*In  Volume  II  of  this  series. 


TABLE  II 

AIRLIFT  MISSION  PROFILE 

Load 

Takeoff 

Climb 

Departure 

Enroute  Cruise 

ATC  Environment 
Ove rwater 
Descent 
Approach 
Landing 
Unload 


For  the  long  hours  overwater,  when  the  aircraft  is 
normally  on  autopilot,  the  navigator  is  the  only  form  of 
human  guidance.  Consequently,  the  performance  during  over- 
water flight  is  mainly  attributable  to  one  man;  the  level  of 
crew  interaction  is  at  a low  ebb.  Measurement  of  the  crew 
therefore  evolves  into  measurement  of  the  navigator's 
individual  performance.  To  some  degree,  such  tasks  can  be 
performed  in  a simulator  environment;  but  in  the  airborne 
environment,  there  are  few  sources  which  may  be  used  to 
double  check  the  navigator's  performance  in  using  Loran,' 
Consolan,  and  Celestial  navigation  devices.  There  is  no  way 
for  a Flight  Examiner  to  determine  navigator  performance, 
except  to  take  separate  fixes  himself,  which  is  not  often 
done  (except  for  very  inexperienced  trainees) . Even  if 
independent  fixes  are  made,  there  are  many  possibilities  for 
differences,  and  large  tolerances  are  permissible.  One 
should  be  able  to  reconstruct  a flight  from  the  navigation 
logs,  and  these  can  be  used  for  evaluation  of  navigator 
performance.  Subjective  evaluation  of  the  detailed  operation 
of  navigational  subsystems  may  still  be  the  most  efficient 
and  cost-effective  method  of  evaluation  for  these  tasks. 

Combat  Airlift  Mission 


Elements  of  the  CAM  profile  are  shown  in  Table  III.  Each 
of  these  will  be  descirbed  here  with  brevity. 

Takeoff . The  formation  is  taxied  with  approximately  one 
aircraft  separation  to  arrive  at  the  runway  precisely  on  time. 
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TABLE  III 

COMBAT  AIRLIFT  PROFILE 

TAKEOFF 
ENROUTE  IFR 
SID 

IFR  FORMATION 
ORBIT  FIX 

COMPRESS  TO  VRF  FORMATION 
ADJUST  TIMING  TO  ACHIEVE  TOT 
LOW-LEVEL 

VFR  FORMATION 
LOW-LEVEL  NAVIGATION 
SLOW  DOWN 
DROP  COUNTDOWN 
DROP 

POST-DROP 

ACCELERATE 

IFR  FORMATION  ASSEMBLY 
RETURN  ROUTE 

VORTAC/ILS 

LAND 

OVERHEAD 


DOWNWIND 


8l  or -a  me-  " jj.  r 1 e timed  t m the  t>.' j i. • ■ ■ • • ng  of  the 
fv-cr.'at  •'  • -n  1 c 'dor  takeoff  *"o!. takeoff  nteeval  timing  is 
based  ou  the  takeoff  roll  of  the  preceding  aircraft.  A rate 
of  climb  between  '000-1500  PPM  (4°-6°  pitch)  is  established, 
accelerating  to  climb  airsce,..-:  when  flaps  ate  retracted. 
Assuming  an  IFR  departure,  tunway  heading  is  maintained  for 
Ik  rninur.es,  then  turning  O.  one  fed  depn  ■-  l ■ ■ re  heading  using 
20°  bank.  A separation  of  Ik  miles  is  o +•■  blished  using 
radar.  At  leveloff  each  aircraft  is  stacked  500  ft.  lower 
than  the  preceding  aircraft..  Sections  of  the  formation  are 
spaced  5-min.  apart - 

Enroute  IFR  and  Orb] c Fix.  An  IFR  descent  and  join-up 
in  an  orbit  pattern  is  performed  using  intrail  descent 
procedures  at  Section  Leaders  command,  throttles  are  retarded 
to  idle  start,  with  spoilers  normally  deployed.  Descent  is 
at  .70M/250KCAS  and  briefed  rate  of  descent  until  base 
altitude  is  achieved  and  each  aircraft  advises  the  section 
leader  that  they  are  VFR.  After  all  aircraft  report  VFR,  the 
section  leader  clears  the  section  to  join  VGR  intrail. 

Departure  from  the  orbit  pattern  is  designed  to  achieve  the 
required  time  over  the  drop  zone. 

Low-level.  A VFR  intrail  formation  is  formed  by  adjust- 
ing the  spacing  to  an  interval  of  2200  ft.  (2-miles  between 
element  leaders)  and  wingtip  clearance  to  avoid  jetwash  and 
wing tip  vortices.  Prior  to  arrival  over  the  drop  zone  (DZ) 
a ten-second  interval  is  established.  While  the  wing  positions 
fly  level  with  the  element  leader,  each  element  stacks  up 
slightly  (25-50  ft.)  with  respect  to  the  previous  elements. 

Each  element  lead  executes  changes  in  heading  or  altitude  over 
the  same  geographic  point.  If  weather  is  encountered,  a 
weather  penetration  maneuver  is  performed  in  which  the 
element  climbs  for  altitude,  and  the  wingmen  turn  out  to 
achieve  2-miles  lateral  separation  and  500  ft.  altitude 
stacking . 

Low-level  enroute  flight  is  between  500-1000  ft.  AGL, 
following  the  contour  of  the  terrain  during  the  day,  and  above 
obstructions  with  5 NM  at  night.  The  lead  aircraft  maintains 
prebriefed  altitude,  while  other  aircraft  fly  altitude 
visually.  One  navigator  of  the  lead  aircraft  directs  the 
formation  to  the  initial  point  (IP)  using  radar  and  computer. 
The  copilot  and  other  navigator  use  visual  map  reading  to 
maintain  awareness  of  aircraft  position.  Time  to  the  IP  is 
adjusted  along  the  route  by  cutting  corners,  or  extending  legs, 
along  the  route  (or  by  varying  airspeed,  if  necessary) . 

At  a specific  time  prior  to  the  computed  air  release 
point  (CARP)  each  element  of  three  aircraft  slows  down 
simultaneously,  maintaining  the  same  separation.  To  provide 
desired  separation  between  elements,  each  element  slows  down 


at  20-second  intervals.  The  "slow  down  time"  will  normally  be 
5-7  minutes  prior  to  the  CARP.  Throttles  are  retarded  to 
idle  start,  decelerating  to  190  KCAS.  flaps  are  deployed  to 
maintain  position.  Briefed  climb/descent  is  maintained,  and 
at  least  150  KCAS,  until  reaching  drop  altitude.  At  the 
briefed  drop  altitude  the  serial  decelerates  to  briefed  drop 
airspeed,  opens  doors,  and  configures  for  drop  (130  K for 
troops,  and  135  K for  equipment  drops). 


Drop  Countdown.  The  navigator  calls  a 20-min.,  10-min., 
6-min. , 3-min.,  and  1-min.  warning  prior  to  the  drop.  At 
each  point,  readiness  for  the  drop  progresses,  and  timing 
becomes  more  critical.  Prior  to  the  CARP,  the  navigator 
gives  a countdown  by  second  until  the  drop  time,  or  "Green 
light",  and  then  "Red  light"  over  the  end  of  the  usable  DZ. 
The  principal  criteria  applied  to  the  CAM  is  to  achieve  a 
circular  drop  error  of  less  than  300  yards  and  time  over 
target  within  90  seconds. 


D rop . Computed  air  release  point  computations  are  made 
while  on  the  ground.  For  a given  object,  the  rate  of  fall 
and  time  of  fall  can  be  determined  from  precomputed  tables. 

The  falling  object  is  assumed  to  follow  a path  of  two  parts: 
a forward  travel  component  in  the  direction  of  the  aircraft 
course,  and  a component  in  the  direction  of  the  wind  after  the 
parachute  is  deployed.  A quick  computation  graph  is  also 
available  which  allows  computation  within  minutes  of  the 
actual  drop.  Ordinarily,  a report  is  received  from  the 
ground  approximately  6-minutes  from  drop  giving  balloon- 
measured  winds.  Based  on  these  wind  reports  (ground  wind, 
wind  at  drop  altitude,  and  mean-effective  wind),  the  time  to 
the  drop  can  be  determined.  The  drop  zone  is  marked  with 
panels,  and  the  time  to  drop  is  measured  with  respect  to  these 
panels  by  visual  reference  and  stop  watch.  The  direction  of 
the  aircraft  trac-k  is  parallel  to  the  DZ  axis,  along  a path 
indicated  by  the  Navigator  to  the  Pilot  as  "X  yards  to  the 
right/left  of  the  DZ  centerline."  The  Pilot  must  crab  into 
the  wind  to  make  this  path  good.  The  pilots  of  the  aircraft,  . 
other  than  the  lead  aircraft,  fly  the  standard  VFR  formation 
into  the  drop  zone.  Due  to  the  crab  required  for  wind 
effects,  misleading  visual  spatial  relationships  may  be 
presented  to  each  pilot  (e.g.,  while  flying  in  the  proper 
position,  it  may  even  look  like  flying  on  the  other  wing  of 
the  lead  aircraft) . Due  to  the  requirement  to  fly  formation 
into  the  DZ , the  lateral  drop  error  is  primarily  the 
responsibility  of  the  lead  aircraft,  the  other  crews  are 
responsible  for  the  error  in  the  direction  of  the  DZ  axis, 
and  the  lateral  error  relative  to  the  lateral  error  of  the 
lead  aircraft  (compensated  for  the  effect  of  formation 
position) . 


Post-drop.  After  the  drop,  acceleration  must  be  delayed 
approximately  two  minutes  to  provide  time  for  the  doors  to  be 
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closed,  and  time  for  the  element  leaders  to  separate  two  miles 
from  the  preceding  element  leader.  Throttles  are  advanced  to 
approximately  80%  Ni  and  then  begin  to  descend/climb  to 
departure  altitude.  Flaps  are  retracted  and  the  flight 
proceeds  to  the  ascent  point.  In  order  to  provide  5-minute 
separation  between  sections  during  post-drop  IFR  vertical 
assembly,  a series  of  pre-planned  ascent  points  are  employed. 
Within  a given  section,  the  leader  turns  using  20°  bank  and 
climb  schedule  at  the  ascent  point,  and  each  aircraft  delays 
performing  the  same  maneuver  by  15  seconds  after  the 
preceding  aircraft.  During  the  climb,  aircraft  attain  1%  NM 
separation  using  radar. 


Return  Route.  The  return  route  is  similar  to  that 
described  in  the  section  above,  entitled  "Enroute  IFR".  The 


main  difference  is  a traffic  control  requirement  for  spacing 
during  instrument  approach  and  landing.  Additional  orbits 
may  be  preplanned,  so  that  each  section  can  hold  until  the 
preceding  section  is. cleared  through  traffic  control. 
Additional  spacing  maneuvers  may  take  place  prior  to  the  IAF, 
with  each  member  of  the  element  intercepting  the  glideslope 
at  different  altitudes. 


Lan cling . For  an  overhead  recovery,  initial  approach  is 


five  or  more  miles  from  the  approach  end  of  the  runway,  at  a 
minimum  of  1500  ft.  and  220  KCAS,  element  wingmen  echelon  on 
command  and  break  over  the  end  of  the  runway,  40°  bank  and 
throttles  to  idle  start.  A level  turn  is  made,  extending 
flaps  at  the  proper  speed,  and  reapplying  power  to  maintain 
160  KCAS.  The  before-landing  checklist  and  spacing  is 
accomplished  on  the  downwind  leg.  The  turn  to  final  is  made 
with  a maximum  of  30°  bank,  lowering  flaps  to  maintain  spacing 
for  a minimum  60-second  interval,  and  maintaining  a position 
above  the  preceding  aircraft.  All  aircraft  land  on  the 
centerline,  or  as  applicable  during  crosswinds,  and  continue 
to  the  end  of  the  runway  as  rapidly  and  safely  as  possible, 
clearing  the  runway  as  quickly  as  possible  with  minimum  use 
of  reverse  thrust. 


The  downwind  recovery  begins  with  entry  of  the  downwind 
leg  at  220  KCAS,  wingmen  echelon  on  command,  and  slow  to 
arrive  abeam  the  approach  end  of  the  runway  at  200  KCAS.  The 
lead  continues  for  a minimum  of  10  sec.  beyond  the  approach 
end,  retarding  throttles  to  idle  start,  and  turning  to  base 
with  a 40°  bank;  succeeding  aircraft  turn  with  sufficient 
spacing  to  provide  a minimum  of  60-sec.  landing  interval. 

Flaps  and  gear  are  extended  on  base  as  airspeed  permits.  The 
turn  to  final  is  made  with  a maximum. of  30°  bank,  and  completed 
no  less  than  500  ft.  AGL  and  ^-mile  from  the  end  of  the  runway. 
Wingmen  cross  the  threshold  with  approach  speed. 
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Crew  Functions 

Flight  Evaluation  Forms.  To  determine  crew  functions 
through  discussions  with  C-141A  crewmembers  at  Norton  AFB, 
the  evaluation  forms  used  during  flight  examinations  were 
discussed  item  by  item.  A special  form  for  CAM  evaluation 
exists  for  th^  Pilot,  while  special  entries  are  available  for 
evaluation  on  the  normal  Copilot,  Navigator,  and  Loadmaster 
forms.  The  Flight  Engineer's  duties  are  essentially  the  same 
on  both  the  normal  mission  and  the  combat  airlift  mission; 
consequently,  no  special  evaluation  of  the  FE  combat  airlift 
role  is  needed.  These  forms  were  discussed  twice,  once  with 
Stan/Eval  personnel  with  respect  to  the  combat  airlift  mission, 
and  once  with  personnel  of  the  14th  MASq  about  normal  airlift 
evaluation . 

Pilot/Copilot.  The  pilot's  task  is  one  of  high  precision 
flying  and  knowledge  of  CAM  procedures;  otherwise,  the  flying 
skills  required  are  basically  the  same  as  required  for  the 
normal  airlift  mission  (with  the  possible  exception  of  the 
slowdown  maneuver) . The  Copilot  must  be  able  to  maintain  CAM 
formation,  operate  flaps,  and  the  air  drop  system.  Both  must 
have  some  understanding  of  the  tasks  performed  by  the  remainder 
of  the  crew  to  properly  coordinate  during  the  airdrop.  The 
Aircraft  Commander  (A/C)  must  brief  the  crew  and  keep  them 
continuously  aware  of  his  intentions,  the  crew  must  monitor 
his  performance  to  assure  that  no  errors  are  made. 

Flight  Engineer.  The  main  responsibilities  of  the  FE  are 
computation  of  the  TOLD  card  (takeoff  and  landing  data) , check- 
lists, all  electrical  system  controls,  fuel  system  weight 
balance,  monitoring  of  all  aircraft  systems,  and  monitoring 
P/CP  use  of  power.  Two  FEs  are  required:  one  mans  the 

interphone,  while  the  other  performs  the  functions  of  scanner 
outside.  The  functions  of  the  FE  must  be  performed  accurately, 
without  major  error.  Many  safety-of-f light  items  are  related 
to  the  FE  function;  therefore,  his  duties  are  quite  important, 
but  nevertheless,  there  is  little  interaction  with  the 
remainder  of  the  crew.  Much  of  these  duties  are  quite  routine. 
An  engine-running  off-load  is  infrequently  performed;  in  such 
a case,  the  FEs  are  directly  related  to  the  length  of  time  for 
off-load,  including  manipulation  of  the  doors.  The  FE  does 
not  receive  any  special  training  for  CAM.  Of  course,  the 
primary  function  of  the  FE  is  to  cope  with  inflight  failure  of 
aircraft  systems;  this  is  difficult  to  assess  during  a normal 
flight. 

Navigator . Two  navigators  (N)  are  used  for  the  lead  CAM 
crew;  otherwise,  only  one  navigator  is  included  in  the  crew 
complement.  The  N will  perform  CARP  computations,  map 
planning,  and  fuel  planning  (monitored  by  FE) . N gives  the 
inflight  warnings  for  the  airdrop  (20-,  10-,  6-,  3-,  1-minutes), 
He  performs  the  airdrop  computation  from  the  quick  computation 
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wind  sheet,  and  may  change  the  drop  time  as  late  as  the 
second-by-second  countdown  preceding  green  light.  He 
establishes  the  slow-down  time  — usually  5-7  minutes  from  the 
drop  to  control  the  TOT.  Enroute  to  the  target,  he  will  call 
turns  and  next  course,  and  briefs  on  time  progress;  one 
navigator  will  call  the  time  while  the  other  backs  him  up.  N 
may  be  responsible  for  such  items  of  safety  as  clearance  for 
wingmen  from  hazardous  terrain,  and  winds  out  of  tolerance  for 
cargo  safety  during  airdrop.  During  IFR  formation  flight, 
one  navigator  stays  on  the  radar  after  Takeoff,  and  watches 
formation  separation  of  \\  miles,  and  clearance  with  surround- 
ing terrain.  One  navigator  will  normally  stay  with  the  radar, 
doppler  and  computer,  while  the  other  navigator  (in  the  lead 
crew)  will  attend  to  charts  and  the  flight  plan. 


The  normal  flight  check  would  include  different  items  and 
different  emphasis  than  the  CAM  flight  check.  The  examinee, 
would  be  watched  for  planning  and  preflight  checks,  use  of  DR 
procedures  and  cross-checking  of  the  flight  instruments . 

Course  tolerances  would  normally  be  imposed  by  air  traffic 
control,  ETA,  ADIZ,  etc.;  overwater  position  may  deviate  as 
much  as  50  miles.  Celestial  sights  must  be  used  in  combination 
with  manual  computations,  and  used  in  checking  compass  heading. 
Use  of  the  LORAN  set  is  evaluated  throughout  the  mission 
because  there  are  so  many  changing  variables.  Use  of  the 
radar  for  weather  penetration  and  providing  guidance  to  the 
air  field  is  evaluated;  for  example,  the  examinee  may  be 
asked  to  take  a fix  on  an  island.  The  examinee  will  be 
quizzed  thoroughly  on  the  use  of  the  computers.  They  will  use 
the  computer  coupled  and  uncoupled  to  the  autopilot;  coordina- 
tion is  required  with  the  pilots  to  uncouple  at  times  during 
the  use  of  TACAN  guidance  to  prevent  the  computer  from  taking 
30°  cuts  on  the  course.  The  use  of  the  digital  computer  for 
flying  grid  is  noted.  In  general,  the  navigator  is  watched 
for  safety  of  flight  items,  and  the  application  of  well- 
planned  and  smoothly-paced  work  habits.  The  examiner  may  go 
over  the  logs  and  charts  afterwards  (e.g.,  Form  25,  Flight 
Plan  and  Record;  Form  25b,  Computer  Flight  Plan;  Form  26, 
Navigators  Flight  Records;  Form  27,  Range  Control;  Form  115, 
Message;  Form  193,  Flight  Folder). 


Loadmaster . Two  loadmasters  fly  on  each  mission.  For 
CAM,  one  loadmaster  stays  on  the  interphone  to  run  checklists, 
while  the  other  LM  does  the  physcial  checks.  The  loadmasters 
must  load  the  cargo  and  maintain  the  C.G.  within  tolerances; 
for  cargo,  they  must  load  so  that  the  C.G.  is  within  ±2  inches 
of  25%  MAC.  However,  since  loads  are  on  pallets  normally, 
this  is  not  too  difficult.  For  passenger  cargo,  LM  must  give 
the  pa'ssenger  briefings  and  attend  to  passenger  comfort 
(blankets,  box  lunches).  For  medical  evacuation  flights, 
flight  nurses  are  along  to  attend  to  patients.  CAM  is  the 
only  mission  where  high  level  of  crew  interaction  takes 
place,  and  rapid  well-coordinated  action  by  the  LMs  is 
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necessary.  In  particular,  a - f ! '-up  after  ti  3~ini.nu.te 
warning  is  likely  t.c  ca  ,.;e  n nr  op  to  occur..  Tf  the 

navigator  is  la*,  e xj  giving  >•  : warning,  j.t  is  also-  very 

likely  that  the  drop  v/ill  not  occur . The  LM  reports  when 
any  paratroopers  delay  in  jumpi.  g,  as  this  will  affect  the 
score  on  that  r-„ 

During  t,  normal  airlift  mission,  the  LM  does  not  have 
much  effect  on  the  performance  o~  the  rest  of  the  crew  unless 
the  cargo  is  improperly  loaded  and/or  the  C . C ..  is  out  of 
tolerance.  The  occasions  for  jettisoning  cargo  are  rare  with 
the  C-141A.  The  major  emphasis  during  the  flight  check  is  on 
preplanning,  forms,  cargo  hand 1 f ru  , normal  emergency 

procedures . 

Crew  Interaction 


Standard  Airlift  Mission.  The  standard  airlift  mission 
is  not  characterised  by  a high  degree  of  apparent  crew 
interaction.  The  standardization  of  aircrews  in  MAC  is  such 
that  a group  of  total  strangers  may  be  selected  from  the 
manpower  pool  and  be  fully  expected  to  perform  a successful 
mission. 

The  two  loadmasters  have  extensive  duties  regarding  the 
loading,  unloading,  and  care  of  cargo;  however,  their 
interaction  with  the  remainder  of  the  crew  occurs  at  time  of 
cargo  loading  and  unloading,  principally,  gross  weight,  and 
weight  and  balance.  Similarly,  the  two  Flight  Engineers  are 
concerned  with  the  state  of  all  aircraft  systems;  however, 
unless  some  sort  of  emergency  occurs,  interaction  with  the 
remainder  of  the  crew  is  limited  to  checklist  reporting,  and 
preparation  of  the  TOLD  (takeoff  and  landing  data)  card  for 
the  pilots.  A greater  degree  of  interaction  occurs  between 
the  Pilot,  Copilot,  and  Navigator.  The  Pilot  (Aircraft 
Commander)  normally  flies  the  aircraft  unless  the  Copilot 
temporarily  relieves  him.  The  Copilot  will  normally  fly  very 
few  takeoffs  and  landings  in  his  career;  for  specialized 
instrument  approaches  he  may  fly  the  throttles.  Otherwise  the 
Copilot  duties  are  res trie ted . to  running  checklists  and 
handling  communications.  The  Navigator  operates  the  equipment 
of  the  navigational  systems  to  determine  position  and  course. 
This  information  is  communicated  verbally,  to  the  pilots 
through  cockpit  displays,  and  directly  to  the  aircraft 
through  the  autopilot.  In  the  terminal  area,  both  the  Copilot 
and  Navigator  monitor  the  flight  for  conformance  with  air 
traffic  control  procedures;  the  Navigator  monitors  the  radar 
to  assure  proper  terrain  clearance. 

Combat  Airlift  Mission.  Since  enroute  IFR  portions  of 
the  combat  airlift  mission  are  essentially  the  same  as  for  the 
standard  airlift  mission,  the  discussion  above  applies  to  both. 
Figure  2 shows  the  basic  air  drop  sequence  described  in  the 
following  paragraphs: 
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The  navigator  is  quite  important,  since  he  is  largely 
responsible  for  the  success  of  the  air  drop.  The  time  over 
the  target  (TOT)  and  the  accuracy  are  determined  by  the 
navigators  (there  are  two  on  the  lead  aircraft  of  the 
formation) , but  they  must  act  through  the  ether  crewmembers 
to  produce  the  desired  result.  The  two  navigators  act  as  a 
tight-knit  team.  They  must  have  major  strategies  and  working 
procedures  developed  prior  to  flight  time,  as  there  will  be 
little  time  for  such  during  the  flight.  One  navigator  (Ni) 
will  normally  situate  himself  behind  the  Pilot,  where  he  has 
good  visibility  forward  and  to  both  sides  of  the  aircraft, 
and  with  direct  communication  with  the  other  navigator  (N2) 
direcr.ly  behind  him.  The  other  navigator  (N2)  will  be 
positioned  at  the  navigation  console,  where  he  can  have  direct 
access  to  the  navigation  displays,  computer,  radar,  and  the 
working  area  available  there.  Ni  acts  as  coordinator  for  the 
flight:  He  is  in  a position  to  see  outside  better  than  anyone 

else  aboard,  so  he  directs  the  flight  over  the  ground  using 
chart  and  stopwatch.  He  assures  that  the  ground  path  is 
precisely  over  the  proper  checkpoints,  that  the  pilots  are 
well  briefed  on  the  proper  relationship  to  other  aircraft  in 
the  formation,  the  proper  track  across  the  drop  zone,  and 
what  is  desired  in  terms  of  altitude  and  speed  control.  He 
assures  that  the  copilot  receives  timely  wind  and  clearance 
information  from  the  team  at  the  drop  zone.  N2  works  with  the 
digital  computer,  and  hand  computer,  to  revise  the  path  and/or 
speed  as  desired  to  achieve  TOT,  the  proper  time  for  slowdown, 
and  may  even  recompute  the  CARP  within  seconds  of  the  drop 
zone  if  mere  recent  wind  information  is  available.  Conse- 
quently, N2  provides  information  affecting  the  TOT  and  the 
drop  error;  Ni  must  attempt  to  ensure  that  the  required 
checkpoints  and  CARP  are  achieved  as  desired  by  N2.  Except 
for  the  display  of  computer- derived  information  on  the  pilots' 
displays,  all  of  the  interaction  information  is  communicated 
verbally. 

If  the  aircraft  is  not  the  lead  aircraft  in  the  formation, 
only  one  navigator  (N2)  is  included  in  the  crew,  as  the  function 
of  Ni  is  performed  by  following  the  lead  aircraft.  The  lead 
crew  assumes  responsibility  for  TOT  and  path  over  the  drop  zone. 

The  pilots,  of  course,  are  in  direct  control  of  the 
aircraft.  During  VFR  formation,  the  copilot  may  fly  the 
aircraft  if  he  is  combat  airlift  qualified;  but  ordinarily 
this  will  depend  upon  the  Aircraft  Commander  and  whether  or 
not.  he  desires  to  be  relieved,  or  to  provide  training. 

Position  in  formation  is  maintained  visually,  with  reference 
to  the  radar  and  timing  of  shadows  for  spacing  information. 

N2  and  the  Copilot  will  keep  close  watch  on  the  radar  during 
joinup.  The  Aircraft  Commander  will  keep  the  radar  in  his 
visual  scan,  and  N2  will  monitor.  If  flying  lead,  care  will 
be  taken  during  turns  to  avoid  banks  over  20°  and  avoidance  of 
terrain,  to  allow  wingmen  to  follow  easily  and  stay  out  of  the 
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rerraui  fi.o.,  inter -aircraft  a;urr)  ■ n;  _^n)  . Dunn . slowdown 
and  approaching  the  drop  7. one  both  p • b ts  and  >' } w?  11  confer 
on  formation  position  an '1  the  proper  pai..n  through  -'.he  drop 
/one.  N ; will  countdown  to  grecnl ighv , and  the  Copilot 
controls  the  release  of  v.hc  cargo  through  the  rear  door, 
however  , they  both  must;  be  sure  that  the.  have  he  arc  the 
Loadinasters  announce  it ■... t the  cargo  b - ready  over  .he  inter- 
phone . 

The  Loadmasters  are  busy  in  the  bar/  of  the  aircraft 
s race  uhe  emnouncement  of  the  2 0-rninutc  warning.  One  Load- 
riaster  (LMi ) mans  the  interphone  , with  "be  other  (LKj- ) 
performing  the  physical  checks.  The  Loadmasters  perform 
eheokxist  items  and  must  respond  at  the  20- , 10- , 6-,  3-,  and 
1-mir.ute  warnings.  As  time  progresses  during  the  last  20- 
minutes,  any  delay,  confusion,  or  mistakes  become  increasingly 
critical.  If  a door-opening  difficulty  is  encountered  in  the 
1 ast • minutes , or  if  the  3-  or  1 -minute  warnings  are  yiven 
late,  it  is  quite  probable  that  a "No-drop"  will  be  called. 

The  Flight  Engineers  do  not  have  specific  roles  in  the 
air  drop  checklists.  TOLD  cards  must  be  read  for  each 
takeoff  and  landing  made  in  the  flight.  Similarly,  for  each 
air  drop,  the  Flight  Engineer  must  compute  drop  airspeed, 
minimum  spoiler  speed,  shaker  onset  speed,  military  rated 
thrust,  fiap  position,  and  minimum  flap  retract  speed.  Other- 
wise, the  role  of  the  Flight  Engineer  is  much  the  same  as  on  a 
conventional  mission. 

Crew  Interaction  Measurement 

A measurement  analysis  was  previously  performed  for  the 
C-130E  to  determine  measurement  requirements  for  the  assess- 
ment of  pilot  performance.  While  this  analysis  generally 
excluded  the  evaluation  of  efforts  of  the  other  crewmembers, 
it  was  found  to  be  impossible  to  avoid  the  measurement  of 
total  system  performance  in  the  accomplishment  of  the  air  drop 
mission,  because  such  data  are  needed  to  properly  interpret 
pilot  performance.  Thus,  the  example  measurement  produced 
was  really  quite  representative  of  the  performance  of  the 
total  crew,  with  some  emphasis  on  the  contributions  of  the 
pilots.  This  conclusion  was  generally  supported  by  data 
collected  through  interviews  at  Norton  AFB  in  regard  to 
performance  of  the  total  crew.  What  is  needed  in  addition  to 
the  example  measurement  previously  presented,  is  information 
which  is  specific  to  the  contributions  of  other  crewmembers, 
and  in  particular,  information  related  to  the  interactions 
between  crewmembers. 

Example  measurement.  The  example  measurement  shown  in 
Figure  3 fer  the  C-141A  Combat  Airlift  Mission,  is  a revision 
and  expansion  over  that  formerly  developed  for  the  C-130E. 

Upon  examination,  it  may  be  seen  that  the  illustrative  measure- 
ment suggested  may  be  classified  as  follows: 
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Mission  Briefing: 

Wx,  routes,  aircraft,  procedures,  navigation,  cargo, 

DZ  descrip. 

Pre-Taxi : 

Checklists:  Before  starting  engines,  Starting  engines, 

Before  Taxi 

Command  markers,  Communications  setup 


Taxi 


Time:  (N  countdown)  'Nose-Tail  sep.:  (min,  max, avg) 

Brakes:  (no . 6 dur . ) Thrust:  (min/max) 


Taxi  checklist 
Takeoff : 

Checklists:  Before  T.O.,  Lineup 

Time  behind  leader:  (N  countdown) 

Rotation  speed:  


Centerline  dev. : 


Thrus  t : 


Joinup : 

After  T.O.,  climb  checklist 

Lead.:  HDG:  Time  at  departure  HDG: 

Alt. 


A/S  : 


Wing:  Time  to  join: 

Acceleration: 


Thrust: 


Time : 


P/CP/N  communications: 
Spacing:  (Rng/brg/Aalt ) 


Standard  Instrument  Departure: 

Time  for  turn:  (N  countdown) 


Crew  calls:  (alt,  restrictions,  level-off,  terrain 

clearance) 


Other  items  as  dictated  by  the  flight  plan 
IFR  Formation: 

Spacing  - ’"ead  referenced:  (Rng/brg/Aalt) 

Crew  checj-.s:  (radar/rng/brg) 

Time  over  checkpoints  •.  

Orbit  Fix: 

Descent  checklist 

IFR  forr  tion  spacing:  (rng/brg/ Aalt) 

VFR  formation  spacing:  (rng/brg/Aait) 

Time  Arrive/Depart  Fix:  / 


Each  Low-Level  Leg  : 

ATA:  Pos . each  HDG  change: 

Alt.: 


Pos.  "over"  fix: 


Spacing : 


Dev.  from  track: 


Bank:  (max)  Terrain 

Clearance : 

Nav.  directions: 


Figure  3.  Example  Measurement 
C-141A  Combat  Airlift  Mission 
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Slowdown 


Time:  (N  countdown)  Location: 


Throttles  to 
Idle : 


Flaps  A/S: 


Drop  alt. 
Drop  A/S: 


(level-off  alt,  time) 


P/CP/N  communications 


Drop  Countdown: 

Interphone:  P/CP/N  1/Ni;/LM1 


P ilots 


Nav . 


LM 

* 


20-min : 
1 0-min : 
6-min : 
3-min : 
1 -min : 


*Time  each  item,  and 
total  check  complete, 
or  not  completed. 


Call  tor  DZ  winds:  (surface,  drop  alt.,  mean  eff.) 

Command  Marker  setup 


Drop  : 


Nav.  instructions  to  DZ : 
Time  - green  light:  


Track  DZ: 


Location : 
CARP:' 


Position  of  Lead:  

Time  - red  light:  Location: 

Alt: 


** 


A/S:  **  HDG : **  G/S : **  Drift:  ** 


* * At  green  and  red  lights,  and  min/max/avg  between  lights 


Range  Score:  (yds/clock  for  lead  and  given  aircraft) 

Difficulties  reported:  E.g.,  LM  reports  jumpers  delay 

at  green  light 


Post-Drop : 

Post-drop  checklist:  time  each  item  and  total  check 

complete 

Time  of  turn:  Accel  time:  (N  countdown,  call  from  lead) 

A/S: 


Thrust:  (time,  amount)  A/S:  HDG: 

Spacing  - VFR  formation:  (rng/brg/Aalt) 

Other  items  as  dictated  by  flight  pain 
Interphone 


Return  Route : 


Request  clearance: 


Climb  checklist: 
Accel,  time: 


Time  turn  to  ascent  pt.  : 

A/S:  V/V:  Spacing  - IFR:  (rng/brg/Aalt) 


Thrust : 


Other  items  as  dictated  by  flight  plan/clearance 
Cruise  checklist 


Figure  3.  Example  Measurement  (Continued) 
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Land  (Overhead) : 


Descent  checklist:  Before  landing  checklist: 

After  landing  checklist: 

P/CP  communications 

Initial:  A/S:  Alt: HDG : Spacing: 


Echelon:  (command,  spacing) 

Break:  Roll:  Thrust:  Alt: 

Downwind:  A/S:  Alt: 

Final:  Roll: 


A/S  : 


Spacing : 


A/S  : 


Alt  (%-mile) : 


Flaps : 


Spacing : 


Time  behind  lead  aircraft 
Touchdown:  Centerline  dev.:  Runway  dist.: 

A/S  : 


Time  behind: 


V/V: 


Use  of  Reverse: 


Post-Mission: 

Nav.  Records 


Flight  plan,  maps,  CARP  computations 
: Post-mission  critique 

Eng.:  TOLD  cards.  Airdrop  quick  ref.  data 

: Post-mission  critique,  maintenance  writeups 
Loadmaster:  Post-mission  critique 

Pilots:  Post-mission  critique 


Figure  3 . Example  Measurement  (Continued) . 
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1.  Aircraft  parameters:  while  aircraft  parameters 

(e.g.,  airspeed , altitude ) are  perhaps  most  directly  related  to 
the  performance  of  the  pilots,  such  performance  may  often  be 
in  response  to  the  performance  of  other  crewmembers;  hence, 
such  data  are  needed  for  the  assessment  of  other  crewmember 


performance  as  well  as  the  pilots 


2.  Position  with  respect  to  other  aircraft;  principally, 
with  respect  to  the  lead  aircraft  during  IFR  formation,  VFR 
formation,  joinup,  or  the  traffic  pattern;  performance  here 
may  be  attributable  to  the  pilots  of  the  lead  aircraft,  the 
wing-position  aircraft,  or  both. 


3.  Position  with  respect  to  the  ground:  generally,  the 

position  and/or  altitude  with  respect  to  the  surrounding 
terrain;  measures  derived  from  these  data  may  be  related  to 
the  performance  of  the  pilots,  the  navigators,  or  all  of  these, 


4.  Specially  sensed  data:  some  data  may  require  special 

sensors,  such  as  the  use  of  brakes,  or  to  determine  liftoff. 


5.  Communications : data  specific  to  crew  interactions 


may  be  derived  from  checklists,  transmissions,  required  and 
voluntary  communications. 


6.  Subjective  data;  other  information  may  be  derived 
from  the  post-mission  critique,  and  special  interviews,  which 
will  reflect  on  crew  performance  and  interaction  (i.e.,  under- 
lying factors  which  may  not  be  directly  observable) . 


Subjective  data  would  probably  be  collected  entirely  on 
the  ground  directly  after  the  mission,  using  tape-recorded 
interviews  and  questionnaires  to  document  the  results.  The 
other  data  would  require  an  airborne  data  collection  system. 
Such  an  airborne  system  must  record  aircraft  parameters,  the 
relative  position  of  the  lead  aircraft  either  through  the 
windscreen  or  the  radar,  geographic  location  either  through 
coordinates  derived  from  the  navigational  systems  or  through 
direct  view  of  the  terrain  underneath  the  aircraft,  and  crew 
communications  through  the  interphone. 


Much  of  this  information  would  be  needed  for  measuring 
total  system  performance;  however,  the  measurement  of  crew 
interactions  places  a much  heavier  emphasis  on  the  recording 
of  crew  communications.  The  interphone  and  interplane 
communications  provide  the  most  direct  source  of  information 
about  the  instructions  given  the  crew  by  the  lead  aircraft,  the 
instructions  of  the  navigator,  whether  the  pilots  erred  or 
whether  they  were  given  erroneous  information,  whether  the 
loadmasters  were  late  in  getting  the  cargo  ready  or  were 
given  a late  warning,  and  other  information  relating  to  crew 
interaction . 
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Crew  ••  'ng-aunicc, trons . Much  of  t he  crew  communications 
have  been  ^ Landardiz.-d  and  abbreviated  tnto  the  form  of 
checklists  In  addition  to  standard  checklists  (before 
starting  engines,  starting  engines,  before  taxi,  taxi,  before 
takeoff,  lineup,  after  takeoff,  cruise,  descent,  before 
traffic  pattern,  after  landing,  engine  shutdown,  and,  before 
leaving  aircraft)  other  checklists  are  included  for  the  combat 
airlift  mission  (20-minute  check,  10-minute  check,  6-minute 
check,  3-minute  check,  and  1-minute  check);  checklists  for 
and  equipment  drop  are  presented  in  Figure  4.  While  these 
checklists  are  quite  routine,  documenting  whether  a given 
item  in  a checklist  was  performed,  and  the  time  of  performance, 
can  provide  a valuable  piece  of  information  in  diagnosing  crew 
interaction  and  total  crew  performance.  For  example,  if  the 
navigator  does  not  call  a 1-minute  warning  the  air  drop  will 
not  be  made;  if  he  calls  the  warning  late,  the  Loadmasters  may 
not  complete  their  1-minute  check  items.  It  will  probably  be 
necessary  to  record  communications  from  each  interphone,  so 
that  evidence  of  two  simultaneous  transmissions  is  available. 

If,  for  example,  the  Navigator  starts  counting  at  the  same 
time  the  Loadmaster  calls  that  his  1-minute  check  is  completed, 
a "no-drop"  will  be  called  because  it  will  be  believed  that  the 
Loadmasters  are  not  ready  for  the  cargo  to  go  out  of  the  door. 

The  major  communications  of  the  Engineer  to  the  Pilot 
(E-P)  and  the  Loadmaster  to  the  Pilot  (LMi-P)  will  be  included 
in  checklist  responses.  The  second  Loadmaster  must  climb 
around  the  cargo  in  performing  the  checklist,  so  does  not  wear 
a headset.  The  other  Loadmaster  ■ (LMi ) monitors  the  interphone 
and  visually  observes  the  checks  physically  performed  by  LM2 ? 
hence,  there  are  generally  no  recordable  conversations  between 
the  Loadmasters  (LMi-LMa).  LMi  announces  that  a given  check  is 
complete.  Mi  will  use  Hot  Mic  during  the  last  minutes  of  the 
drop;  otherwise,  conversations  between  navigators  (N1-N2)  will 
not  always  be  over  the  interphone,  and  therefore  not  always  be 
recordable .. 

The  remaining  communication  pairs,  pilot  and  copilot 
(CP-P) , and  navigator  and  pilot  (Ni-P),  are  themost  important. 
The  copilot  has  some  normal  responsibilities,,  but  these  may  be 
changed  unpredictably  by  the  pilot.  The  communications  between 
pilots,  who  are  normally  Hot  Mic,  indicate  the  tasks  of  each 
pilot,  information  provided  by  one  to  another,  how  they  are 
interacting,  and  often  an  immediate  assessment  of  the  perform- 
ance of  the  other.  The  Navigator  to  Pilot  link  is  the  principal 
flow  of  guidance  information  (see  Figure  5) ; as  such,  it 
provides  command  data  upon  which  the  pilots  are  to  control  the 
aircraft,  presumably  in  an  appropriate  manner  to  accomplish  the 
mission.  The  navigator  of  the  lead  crew  gives  guidance 
commands  to  the  drop  zone  which  directly  affect  the  drop  scores 
of  the  entire  formation. 
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Figure  4.  Equipment  Drop  Checklist  (Continued). 
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Figure  4.  Equipment  Drop  Checklist  (Continued) . 
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Figure  4.  Equipment  Drop  Checklist  (Continued). 
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III.  F-4E  CREW  PERFORMANCE  MEASUREMENT 


Performance  measurement  requirements  can  be  visualized  at 
two  general  levels,  (1)  total  crew-system  performance,  and 
(2)  crewmember-system  performance.  The  total  crew-system 
performance  level  measure  the  effect  of  the  combined  perform- 
ance of  all  crew  members  on  vehicular  or  mission  performance. 
At  the  crewmember-system  level,  the  effect  of  each  crewmember 
can  be  described  in  terms  of  his  performance  with  the  sub- 
systems under  his  control.  Since  the  composite  of  each 
crewmember  working  with  his  subsystems  will  in  some  way  affect 
mission  performance,  the  interaction  between  the  crew  members 
must  be  identified,  and  measurement  of  that  interaction 
defined. 


Total  crew-system  or  mission  requirements  differ  little 
from  previously  specified  pilot-system  performance  require- 
ments1. For  example,  intercept  performance  measurement  was 
described  for  the  F-106  pilot-system.  Ground  attack,  BFM/ACM 
and  latter  portions  of  refueling  were  described  for  the  F-4 
and  A-7.  Similarly,  measurement  of  transition  and  instrument 
phases  was  described  at  the  pilot-system  level.  The  F-4E  crew 
must  perform  the  same  maneuvers  that  are  performed  by  the 
single  pilot  aircraft  (A-7  and  F-106);  therefore,  the 
existing  system  performance  measurement  "specification" 
accurately  reflects  the  total  crew-system  performance 
requirements . 


At  the  crewmember-system  performance  level,  the  measure- 
ment situation  changes  slightly  because  the  tasks  that  were 
allocated  to  one  pilot  have  been  split-up  between  the  crew 
members.  The  F-4E  configuration  forces  a general  division  of 
duties  based  on  the  rear-seat  placement  of  the  radar,  the  INS, 
WRCS  and  EW  controls.  For  those  tasks  which  the  pilot  retains 
primary  responsibility,  the  previous  measurement  requirements 
analysis  still  applies.  For  mission  segments  which  require 
the  use  of  rear-seat  subsystems,  the  crewmember-system 
performance  is  identifiable  because  there  is  a clear . definition 
of  tasks  for  the  second  crewmember,  his  tasks  are  related  to 
specific  subystems,  and  within  those  subsystems  measurement, 
points  are  available.  However,  since  the  aircraft  carries  a 
second  crewmember,  his  participation  can  be  a valuable  asset 
in  any  flight  regime,  not  just  those  that  involve  his 
subsystems. 


For  the  F-4E  rear  seater,  the  performance  measurement 
situation  for  tasks  that  do  not  involve  radar,  INS,  WRCS,  or  EW 
becomes  more  vague  because  the  performance  and  coordination  of 
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two  people  are  immersed  in  the  total  system  performance,  the 
“split"  or  division  of  duties  is  not  always  a clean  one.  In 
current  practice  the  division  of  duties  is  not  defined;  crew 
coordination  is  left  up  to  the  discretion  of  each  aircraft 
commander.  In  order  to  generate  measurement,  however,  the 
interaction  between  the  crew  must  be  understood  well  enough 
to  permit  measurement  development.  An  analysis  of  crew  per- 
formance requirements  was  conducted  to  develop  such  an  under- 
standing in  order  to  specify  measurement  points. 


Crew  Performance  Requirements  Analysis 


It  is  helpful  to  distinguish  between  mission  segments  that 
are  primarily  non-radar  and  segments  that  are  radar  oriented 
because  the  crew  tasks  change.  The  pilot's  task  in  the  non- 
radar environment  are  more  clearly  related  to  system  perform- 
ance than  the  v'SO’s  tasks.  The  WSO's  tasks  and  pilot  tasks 
are  probably  equally  related  to  system  performance  in  the  radar 
environment.  Each  environment  is  briefly  reviewed,  fully  re- 
alizing that  this  dichotomy  is  artificial;  there  are  over- 
lapping task  areas . 


Non-radar  mission.  An  analysis  of  training  documents  and 


summary  of  interview  with  instructor  and  Stan/Eval  pilots 
(Table  IV)  reveals  that  the  WSO  duties  in  the  non-radar  category 
can  be  simply  stated;  Be  a good  copilot.  That  definition, 
though  accurate,  is  not  sufficient  for  measurement.  For  meas- 
urement development  purposes,  one  can  examine  the  Pilot — WSO-- 
Aircraft  relationship  with  the  use  of  Figure  6. 
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Figure  6 


Crew-System  Relationships 
Non-Radar  Mission 


It  can  be  seen  that  a "parallel"  relationship  exists  in 
which  the  pilot  is  simply  provided  with  additional  information 
from  the  WSO,  who  can  partially  help  the  pilot  control  the 
vehicle.  Note  that  the  WSO  has  access  to  much  information, 
but  does  not  have  control  execution  authority.  Any  control  he 
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TABLE  IV 

SAMPLE  OF  WSO  TASKS  IN  A NON-RADAR  ENVIRONMENT 


PHASE 

TASKS 

TRANSITION 

Flight  Instrument  Interpretation 
Basic  Aircraft  Control 
Recovery  From  Unusual  Attitudes 
Checklist  Reading 
Visual  Lookout 

Call  Gear,  Flaps;  Read  Altitude,  AOA,  A/S 
Monitor  Procedures,  Fuel  State,  etc. 

INSTRUMENT 

Flight  Planning,  Meterology,  DD  175 
Interpretation  of  SID’s,  Letdown's  Charts 
Correlation  of  Pubs  and  Flight  Progress 
+ TRANSITION  Tasks 

FORMATION 

Know  Hand  Signals 
Inform  Pilot  of  Formation  Status 
Monitor  Aircraft  Status  and  Subsystems 
Judge  Distance  and  Closure  Rates 
+ TRANSITION  and  INSTRUMENT  Tasks 

ACM 

Know  Potential  g's  and  Energy  Maneuverability 
Watch  AOA  and  Aileron  Input  at  High  AOA 
Visual  Search,  Radar  and  Aircraft  Monitoring 
Describe  Opponent's  Location  and  Maneuvers 
Interpret  Opponent's  Maneuvers  (Some  pilots 
would  ..ike  corrective  action:  Reverse,  etc.) 

Radar  and  Switchology  as  required 
+ FORMATION,  INSTRUMENT  and  TRANSITION  Tasks 

GROUND 

ATTACK 

Checklists  and  Switchology  for  Each  Event 
Read  Altitude,  A/S,  Attitude  as  Required 
Record  Vehicle  Parameters  at  Pickle 
Participate  in  Error  Analysis 
Visually  Track  Other  Aircraft 
Monitor  g's  AOA  on  Recovery  and  Entrv 
+ FORMATION,  INSTRUMENT  and  TRANSITION  Tasks 

GROUND 

ATTACK 

(TACTICAL) 

Basic  Visual  Navigation,  Map  Reading 
Target  Recognition 

Radar  for  Ranging  and  V as  Required 
+ GROUND  ATTACK,  etc.  Tasks 

DART 

FIRING 

Coach  A/S  and  Overtake  From  Radar 
+ FORMATION,  etc.  Tasks 

ALL  PHASES 

Mental  Computations,  Rules  of  Thumb  (No  Time 
to  use  Computer  for  Navigation) 
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excerclses  (of  system  performance!  Is  through,  the  pilot,  pri- 
marily through,  an  auditory  link.,  and  secondarily  through  a 
command  steering  input  to  the  pilot's  instruments  through  the 
WRCS . Except  for  rear  seat  circuit  breaker  control,  a few 
switches,  radar  and  navigation  items,  the  pilot  could  perform 
his  function  without  the  WSO. 

In  this  parallel,  ideal  copilot  role,  the  WSO  reads  check- 
lists, provides  the  pilot  with  information,  performs  navigation, 
operates  radios,  and  monitors  the  pilot  for  compliance  with 
clearances,  procedures  and  safety  items.  To  perform  effectively, 
it  is  apparent  that  the  WSO  must  know  the  pilot's  job  well. 

The  WSO' s role  in  navigation  is  slightly  more  active.  He  has 
control  of  the  INS,  WRCS,  radios  and  radar. 

The  principal  measurement  point  for  WSO  performance  in  the 
non- radar  mission  is  the  auditory  link.  There  is  no  other  way 
of  knowing  what  the  WSO  is  doing  inflight,  or  the  extent  to 
which  he  knows  his  job  of  providing  timely  and  accurate  infor- 
mation to  the  pilot. 


Radar  mission.  During  radar-oriented  mission  phases  the 
role  of  the  WSO  is  more  readily  related  to  overall  system  per- 
formance. Note  in  Figure  7 that  the  direct  input  line  from  the 
ground  or  air  target  (see  Figure  6)  to  the  pilot  has  been  re- 
placed by  a visual  link  with  tfee  radar  set  and  the  primary 
auditory  link  with  the  WSO: 


Figure  7.  Crew-System  Relationships 
Radar  Mission 

Using  radar,  the  WSO  controls  the  aircraft  via  auditory  commands 
to  the  pilot  and  through  command  steering  inputs  to  the  ADI/HSI 
as  a consequence  of  WRCS/INS  operation  and  update.  The  direct 
relationship  between  WSO  system  operation  and  vehicle  or  mission 
performance  remains  obscured  by  the  pilot-vehicle  control  re- 
lationship. The  pilot  can  make  the  WSO  look  good  or  bad  in 
terms  of  mission  success  (and  vice-versa) . 

Switchology,  radar  setup  and  radar  sub-system  operation 
provide  a direct  measurement  of  WSO-Subsystem  performance. 
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Auditory  measurement  is  again  required  to  identify  what  the  WSO 
is  telling  the  pilot  and  for  additional  comparisons  of  commands 
the  pilot  receives  and  the  resulting  actions  that  the  pilot 
takes  with  the  vehicle.  Only  in  the ‘ situation  where  the  pilot 
complies  immediately  and  exactly  to  WSO  commands,  will  the 
total  system  or  mission  performance  reveal  WSO  proficiency. 

It  is  extremely  doubtful  that  the  pilot  will  exactly  comply 
to  WSO  commands  for  a variety  of  sound  reasons  (such  as  energy 
level,  fuel  state,  other  information  etc.).  Therefore, 
measures  of  WSO  proficiency  at  the  system  performance  level  are 
confounded. 

Approaches  to  multi-crew  measurement.  In  order  to  accu- 
rately measure  an  individual's  performance,  the  input  stimuli 
(what  he  senses)  and  his  output  responses  (.what  he  does  with 
the  information)  should  be  numerically  described.  In  the  F-4E 
situation  the  pilot  controls  the  aircraft,  so  assumptions  can 
be  made  about  the  pilot's  skill  based  on  his  input  to  the  air- 
craft and  subsequent  aircraft  maneuvering.  For  the  WSO,  the 
input  stimuli  can  be  specified  partially,  but  except  for  direct 
manipulation  of  his  subsystems,  his  control  output  is  verbal — 
to  the  pilot.  In  order  to  generate  measurement,  one  must  define 
at  least  candidate  relationships  between  the  two  crew  members. 

Two  approaches  to  defining  the  relationships  between  the 
two  crew  members  appear  feasible.  One  approach  is  to  construct 
a model  of  an  ideal  operator  for  each  crew  position  and  to 
measure  the  consequences  of  known  variations  of  each  on  system 
or  mission  performance  by  iteratively  exercising  the  models  in 
a computer.  It  is  possible  that  such  an  approach  would  reveal 
the  significant  elements  of  performance  for  each  crewmember, 
and  might  serve  to  reduce  the  required  measurement  set  to 
manageable  proportions.  This  approach  assumes  the  existence 
of  sufficient  data  to  construct  models.  Although  there  are 
potentially  useful  pilot  models  available  as  a point  of  de- 
parture, insufficient  data  have  been  collected  to  model  the  WSO. 

The  other  approach  requires  a reasonable  analysis  of  the 
tasks  and  training  situation,  followed  by  construction  of 
candidate  measurement  sets  which  will  be  subjected  to  empirical 
testing  and  revision  once  sufficient  initial  and  later  normative 
data  are  collected.  Previous  experience  clearly  demonstrates 
that  our  analytic  tools  are  insufficiently  robust  to  predict 
all  relevant  relationships  in  complex  vehicle  training;  the 
combined  analytic-empirical  approach  will  succeed  if  proper 
flexibility  is  built  into  the  measurement  system  for  iter- 
ative changes. 
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In  relation  to  the  F-4E  crew  measurement  problem,  this 
approach  requires  measuring  all  relevant  system  and  subsystem 
states  (called  out  by  analyses)  in  addition  to  measuring  the 
auditory  link  between  the  two  crew  members.  An  enormous  amount 
of  data  would  be  generated.  These  data  would  have  to  be  sifted 
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and  filtered  by  research,  studies.  If  current  training  doctrine 
is  observed,  it  can  be  anticipated  that  each,  crewmember  and  each 
crew  will  operate  with  a slightly  different  relationship;  crew 
coordination  is  largely  determined  by  each  aircraft  commander, 
not  by  doctrine. 

It  is  an  inescapable  conclusion  that  measurement  of  the 
verbal  interchange  between  the  crewmembers  is  necessary.  For 
active  use  of  the  measurement  system  in  training,  instructor 
personnel  have  indicated  a need  for  a voice  track  with  every 
conceivable  measurement  medium.  For  research  purposes,  the 
analysis  concludes  that  only  through  the  measurement  of  the 
audio  channel (s)  can  the  input  and  output  of  each  crew  member 
be  fully  described. 

Communication  Analysis 

An  analysis  was  undertaken  to  determine  a potential 
structure  for  communication  data.  The  analysis  first  revealed 
that  auditory  information  transfer  must  be  measured  both  ways. 
The  pilot  could  be  as  guilty  as  the  WSO  of  providing  the  wrong 
information,  or  untimely  information  with  respect  to  the  other 
man's  job.  It  is  clear  that  each  must  know  well  the  other  man's 
job  in  order  to  know  what  information  is  helpful,  and  when  to 
provide  it.  Information  exchange  provides  a method  of  measuring 
this  knowledge. 

Preliminary  analyses  reveal  that  the  information  transfer 
is  not  as  expansive  as  one  might  initially  suppose.  For  most 
mission  situations  there  is  a specific  vocabulary  and  syntax 
required.  Procedures  have  been  standardized  to  the  extent  that 
it  is  possible  to  structure  auditory  measurement.  Vocabulary 
and  procedures,  and  measurement  structure  will  be  discussed. 

Vocabulary  and  procedures.  During  ground  attack  train- 
ing the  patterns  and  delivery  parameters  are  standardized.  A 
typical  pattern  is  shown  in  Figure  8.  The  mission-related 
communication  requirements  are  implied  by  the  profile  and 
delivery  parameters  shown  on  the  charts.  For  these  canned 
missions,  tables  of  required  auditory  communications  can  be 
constructed.  Actual  communications  can  be  compared  against 
these  tables. 

During  air-to-air  training,  the  WSO — Pilot  command  action 
vocabulary  is  shown  in  Table  VI.  Again,  communication  tables 
can  be  constructed,  actual  communications  compared  against  the 
standard  vocabulary,  and  the  accuracy  of  the  communication  can 
be  compared  against  the  measured  aircraft  situation  at  the 
moment  in  computer  analysis.  For  directive  commentary,  the 
commands  given  by  the  WSO  to  the  pilot  are  finite.  The  system 
performance  change  anticipated  as  a consequence  of  each  command 
is  stated  in  Table  V,  and  shown  in  flowchart  form  in  Figures 
9-11.  Expected  changes  in  system  performance  can  be  tabled  in 
computer  analysis  and  once  the  time  of  a particular  command  is 


known,  the  resultant  system  performance  change  can  be  measured 
against  the  command. 

Thus,  the  vocabulary  is  standard,  and  the  relationship 
between  vocabulary,  mission  requirements  and  system  performance 
can  be  structured  for  computer  analysis. 


TABLE  V 

DIRECTIVE  COMMENTARY 


Cc 

. T' 

ACTION  TO  BE  TAKEN 

a. 

Climb" 

Climb  1000  FPM  maintaining 
airspeed . 

b. 

"Climb  More" 

Increase  climb  1000  FPM 
maintaining  airspeed. 

c. 

"Hold  Climb  or 
Hold  Descent" 

Maintain  present  rate  of  climb 
or  descent. 

d. 

"Go  Down" 

Descent  1000  FPM  maintaining 
airspeed . 

e. 

"Down  More" 

Increase  rate  of  descent 
1000  FPM  maintaining  airspeed. 

f . 

"Nose  Up" 

Maximum  rate  of  descent  (not 
required  to  maintain  airspeed) . 

g- 

"Dive" 

Maximum  rate  of  descent  (not 
required  to  maintain  airspeed) . 

h. 

"Level  Off  a Little" 

Decrease  rate  of  climb  or 
descent  1000  FPM. 

i. 

"Level  Off" 

Return  to  level  flight;  AC 
replies  "Level".  (Note:  It 

is  possible  for  the  pilot/WSO 
to  give  elevation  changes  for  a 
certain  number  of  feet.  AC 
calls  "Level"  after  correction 
is  completed)  . 

j- 

"Hold  Speed" 

Maintain  present  airspeed 
(AC  replies  "Speed  set")  . 

k. 

"Increase" 

AC  repeats  command  and 
■increases  airspeed  as  required 
by  pilot/WSO.  When  speed  is 
attained,  AC  calls  "Speed  set". 

1. 

"Throttle  Back" 

AC  repeats  command  and  decreases 
power  as  required  by  pilot/WSO. 
AC  then  replies,  "Speed  set". 

m. 

"Throttle  Right 
Back" 

Speedbrakes  fully  extended; 
minimum  airspeed  (AC  notified 
when  minimum  airspeed  is  reached) . 
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TABLE  V 


DIRECTIVE  COMMENTARY  (.CONTINUED) 


Command 

ACTION  TO  BE  TAKEN 

n . 

"Easy  Port  or 
Starboard" 

15°  of  bank. 

o . 

"Port  of  Starborad" 

30°  bank  left  or  right, 
maintaining  airspeed  and 
altitude . 

P- 

"Port  or  Starborad 
Hard" 

45°  left  or  right  main- 
taining airspeed  and  altitude. 

q- 

"Harder Hold" 

Increase  degree  of  bank  until 
pilot/WSO  gives  "Hold"  or  until 
a "Hard  as  possible"  turn  is 
reached.  AC  notifies  pilot/WSO 
when  a maximum  rate  of  turn  is 
reached . 

r . 

"Port  of  Starboard 
Hard  as  Possible" 

Maximum  degree  of  bank  main- 
taining airspeed  and  altitude. 

s . 

"Ease  Off" 

AC  decreases  degree  of  bank  until 
the  pilot/WSO  gives  "Hold"  or 
until  aircraft  is  steady.  (AC 
notifies  pilot/WSO  when  aircraft 
is  steady) . 

t . 

"Hold" 

Maintain  present  bank. 

u . 

"Steady" 

Return  to  straight  flight. 
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TABLE  VI 


descriptive  commentary 


Comment. 


MEAN LNG 


a. 

"Azimuth" 

Target Cs)  position  in  degrees, 
port  or  starboard,  from  the 
centerline  of  the  radar  scope. 

b . 

"Elevation" 

Target Cs)  position  in  degrees, 
above  or  below,  from  the  le 

marker  on  the  scope. 

c . 

"Range" 

Range  in  miles  as  indicated. 

d. 

"Overtake" 

Overtake  in  knots  as  indicated 
by  the  Vc  gap  or  estimated 

4 . Other 


a.  "Breakaway  Heading" 

b.  "Converging  Flight" 


Heading  to  establish  immediately 
after  attack. 

Exists  if  the  extended  flight 

paths  cross  in  front  of  bot 
aircraft . 


"Diverging  Flight" 


Flight  paths  other  than  converging, 


d.  "Track  Crossing 
Angle" 


e.  "Compass  Error 


f.  "Scope  Error 


The  angle  formed  by  the  extended 
flight  paths  any  time  converging 
flight  exists. 

The  difference  between  the  heading 
of  the  fighter  and  the  desired 
heading . 

The  difference  between  the  azimuth 
of  the  target  on  the  scope  an 
the  desired  azimuth. 


g.  "Hold" 

h.  "Fox-Trot  Control" 

i.  "Passing  Safe" 


Hold  fire. 

Call  sign  of  telemetry  site. 


Call  made  by  IP  when  passing 
clear  of  tow  aircraft. 


j.  "Romeo  Number" 


Missile  serial  number  CR-0000)  - 
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TABLE  VI 

DESCRIPTIVE  COMMENTARY  (CONTINUED! 


Comment 

MEANING 

k . 

"Shooter " 

Firing  aircraft. 

1. 

"F  Number" 

Telemetry  Pack  Frequency 
Designator  (FI,  F2,  F3,  F4,  or 
F5)  . 

m. 

"Dart  Firing 
Series" 

One  high  speed  and  one  low 
speed  firing  pass. 

n . 

"Dart  Firing 
Sortie" 

One  flight  sortie  - One  flight 
of  one  aircraft  tha.t  has  completed 
2 dart  firing  series  or  obtained 
a hit  on  the  dart. 

o. 

"Target" 

Towed  TDU-22B,  TDU-25B. 

P- 

"Tow" 

Tow  aircraft. 

q. 

"Clear  to  Fire" 

Used  only  to  indicate  clearance 
to  fire. 

r . 

"Nancy  Sweet" 

Audible  high-pitched  IR  tone. 

s . 

"Nancy  Sour" 

Inaudible  high-pitched  IR  tone. 

42 


/ **>•  \ 
FUSIBLE  :t/t! 
M»Sfru>  4 
VJiiTITUrj*  / 


iftCiriC 
v.nBtn 
or  nrc 

> UTAH  in; 


RABIDLY  itrt 


J M0  \ 

'^ii»(r.Afs>rj 

ifj&ijir1! 

^ p^tnn*' ) 

<3~<s 

*Af  y JBED 

x.  > 

N/ 

/^\, 

/fikWA^V 

3—/  *mk«jr»f  k 

i < 

Hf  Da  :»»ASt 

v / 

SST»  %K*y>r 

\D» 

PITCHES 
AIRCRAFT  UP: 
THROTTLES  AT 
SAME  SETTING 


NOSE 

ur- 


PITCH 

ANCLE 

CHANCE 


PITCHES 
AIRCRAFT  DOWN 
THROTTLES  AT 
SAME  SETTING 


MAINTAINS 
PRESENT 
PITCH  ANGLE 


ELEVATION 
. CHANGE 


SETS  IN  A 
CLIMB  AND 
FULL  MILITARY 
POWER 


•CLIMB 

BUSTER 


SETS  IN  A 
CLIMB  AND 
MAXIUM 
POWER 


SETS  IN  A 
CLIMB  AT 
A SPECIFIC 
RATE  IN  FT/MIN 


"CLIMB " 

(SPECIFIC  RATE 
IN  FT/MIN) 


SETS  IN  A 
MAXIMUM 
RATE  DESCENT 


DIVE 


TYPE 


SPECIFIC 

RATE 


SETS  IN  A 
DESCENT  AT 
A SPECIFIC 
RATE  IN  FT/MIN 


DOWN " 

(SPECIFIC  RATE 
IN  FT/MIN 


MAINTAINS 
PRESENT 
DIVE  RATE 


"HOLD 

DIVE" 


RETURNS 
TO  LEVEL 
FLIGHT 


LEVEL 

OFF" 


COMMUNICATION 

LINK 


RIO 

DECISIONS 


PILOT 

ACTIONS 


EXIT 

elevation 

CHANGE 


45/46 


Sample  Flow  Diagram  for  Pilot-RlO  Communications; 
Elevation  Changes. 
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Figuie  9.  Sample  Flow  Diagram  for  Pilot-RIO  Communications 
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IV.  COMMUNICATIONS  MEASUREMENT  SYSTEM 


Since  the  analysis  of  crew  communications  appears  to  be 
vital  for  the  investigation  of  crew  interactions  and  crew 
performance,  the  details  of  such  measurement  will  be  expanded 
upon  in  tne  following  paragraphs.  The  analysis  of  communications 
presents  at  least  two  problems : How  does  one  extract  the 

meaningful  information?  And,  what  procedure  should  be  followed 
so  that  the  information  can  be  identified,  standardized,  and 
processed  along  with  information  of  other  forms  (e.  g.,  altitude, 
weapons  delivery  scores)  into  a common  data  base  for  compre- 
hensive analysis.  Therefore,  the  remainder  of  this  chapter*  is 
devoted  to  identifying  the  categories  of  measurement  possible, 
and  the  details  of  a candidate  communications  data  system. 


Measurement  Categories 


Review  of  information  transfer  required  of  the  mission 
segments  being  trained  reveals  six  measurement  categories, 

(1)  timing,  (2)  accuracy,  (3)  brevity,  (4)  number  and  frequency, 
(5)  information  content,  and  (6)  performance  changes  as  a 
consequence  cf  communication. 


Timing . A frequent  problem  with  the  neophyte  crewmember 
is  a failure  to  recognize  what  is  important;  he  does  not  know 
how  to  place  priorities  on  the  information  needs  of  the  other 
crewmembers  relative  to  the  flight  situation  of  the  moment. 
Instructor  interviews  reveal  that  the  student  will  frequently 
jam  a more  important  communication  with  something  of  less  im- 
portance at  the  moment.  For  example,  early  in  training,  the 
neophyte  may  read  the  after  take-off  checklist  at  the  moment 
that  departure  control  is  changing  the  flight  clearance. 
Measures  of  information  timing  should  reveal  the  following: 
a.  Jamming  more  important  messages 

Providing  information  at  the  wrong  time 
Delay  in  providing  information 

Pacing — providing  information  at  a rate  that  permits 
effective  response  by  other  crewmember. 


b, 

c , 
d 


Accuracy . Measures  of  accuracy  require  the  comparison  of 
what  is  being  said  relative  to  the  measured  situation.  Is 
the  bogey  at  10  o'clock,  or  is  it  at  8 o'clock?  Are  the  instru- 
ment readings  accurate,  or  did  the  crewmember  make  a 1,000  ft. 
altimeter  reading  error?  Is  the  radar  interpretation  correct? 
Was  the  hot-cold  side  determination  made  properly? 


Brevity.  Interviews  have  all  revealed  that  in  combat  the 
radio  and  interphone  traffic  far  exceeds  the  channel  capacities 
In  a fight  or  over  a target  there  can  be  so  much  traffic  that 
it  is  virtually  impossible  to  tell  who  is  saying  what  to  whom. 
Within  the  existing  structure  and  communication  system  of  the 
strike  forces,  the  only  action  that  can  be  taken  is  to  over- 
train brevity  and  to  strictly  enforce  radio  discipline.  A 
standard  vocabulary  has  been  developed  (Operational  Brevity 
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code.  Table  VII)  to  relieve  congestion.  Strict  disciplined  use 
of  this  code  should  be  trained,  and  measured . 

In  addition  to  measures  of  compliance  to  the  brevity  code 
for  standard  situations,  measures  of  length  of  communications 
should  be  included  in  this  category.  Measures  of  communication 
length  reflect  the  student's  facility  with  the  brevity  code, 
and  provides  measurement  of  non-standard  information  transfer 
brevity . 

Number  and  frequency.  Closely  associated  with  brevity  is 
the  number  of  communications  and  the  frequency  of  communications 
(number  per  unit  time)  . Analyses  of  communication  frequency 
have  reflected  the  state  of  skill  acquisition.  For  example, 
one  study  found  that  crews  who  were  experienced  communicated 
less  during  routine  operation  than  inexperienced  crews.  Con- 
versely, however,  the  experienced  crews  communicated  more  fre- 
quently during  weapons  delivery  than  the  inexperienced  crews1. 
Recent  interviews  with  IWSO's  at  George  AFB  suggested  that  the 
number  and  frequency  of  communications  is  an  indicator  of  pro-  . 
ficiency.  Neophyte  WSO ' s appear  to  say  little  until  they  become 
more  knowledgable . A training  milestone  is  felt  to  occur  once 
the  WSO  starts  talking. 

Information  content.  As  communication  skills  improve,  the 
information  transmitted  per  unit  of  time  should  reveal  skill 
acquisition.  Presumably,  a crewmember  could  transmit  less  often, 
but  say  more  (or  less)  per  transmission.  Previous  research  by 
Siskel,  et.al.,  suggests  that  information  content  does  not  vary; 
a simple  measure  of  the  number  of  communications  suffice.  How- 
ever, it  is  felt  that  information  content  should  be  measured 
to  insure  that  other  measures  are  not  contaminated  by  changes 
in  information  content. 

Performance  changes.  The  end  goal  of  communicating  is  to 
affect  system  performance  changes  to  enhance  mission  success. 

When  a crewmember  other  than  the  pilot  is  indirectly  controlling 
the  mission,  then  measures  should  identify  if  the  controller  got 
what  he  asked  for.  Similarily,  the  measures  should  identify 
whether  or  not  the  controller  was  asking  for  a performance  change 
that  was  reasonable  (ie:  was  the  controller  expecting  the 

impossible?).  System  performance  measures  should  relate  to  the 
whole  auditory  measurement  set  to  begin  the  task  of  identifying 
"optimum"  auditory  communication  strategies.  The  author  is 
aware  of  no  clear  criteria  for  training  this  skill,  other  than 
the  concept  of  "pacing"which  is  vaguely  defined. 


Siskel,  M.  , Lane,  F.  D.,  Powe,  W.  E.  , and  Flexman,  R.  E. 
Intra-Crew  Communication  of  B-52  and  KC-135  Students  and 
Combat  Crews  During  Selected  Mission  Segments.  USAF  AMRL- 
TR- 65-18,  May  1965.  (AD  617  598) 


50 


TABLE  yil 


OPERATIONAL  BREVITY  CODE 


WORD 

MEANING 

a . 

"Anchor " 

Orbiting  a visual  orbit  point. 

b . 

"Angels" 

Altitude  in  thousands  of  feet. 

c . 

"Bent" 

Equipment  indicated  inoperative 
or  unserviceable. 

d. 

"Bogey" 

Unidentified  aircraft. 

e. 

"Buster " 

Fly  at  military  power. 

f . 

"Chatter" 

Communications  jamming. 

g- 

"Chatter mark" 

Start  communications  jamming 
countermeasures . 

h. 

"Check  ° Port" 
"Check  ° Star- 
board " 

Alter  heading  degrees  left 

or  right  momentarily  for  air- 
borne radar  search  and  then 
resume  heading. 

i . 

"Chicks" 

Friendly  fighter  aircraft. 

j • 

"Contact" 

I have  a target  on  my  radar . 
(Aircrew  will  call  contact 
with  azimuth  and  range.) 

k . 

"Expedite" 

As  quickly  as  possible;  hurry 
up . 

1. 

"Faded" 

Contact  has  faded  from  ground 
radar . 

in. 

"Famished" 

Have  you  any  instructions  for 
me? 

n. 

"Feet  wet" 

Aircraft  is  over  water. 

o . 

"FOX  I" 

AIM- 7 deployment. 

P- 

"FOX  II" 

AIM- 9/ 4 deployment. 

q- 

"Fuel" 

Amount  of  fuel  remaining  Cin 
pounds).  Give  tape  over  counter. 

r . 

"Gadget" 

Airborne  intercept  radar. 
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TABLE  VLI 


OPERATIONAL  BREVET Y CODE  (CONTINUED) 


WORD 

MEANING 

s . 

"Gate" 

Fly  at  maximum  possible  power. 

t . 

"Heads  Up" 

Target  got  through. 

u . 

"Holding  Hands" 

Aircraft  in  close  formation. 

V . 

"Home  Plate" 

Home  airfield. 

w . 

"Judy" 

I am  taking  over  the  intercept. 
CLock-on  not  required.  Controller 
will  not  acknowledge  but  will 
cease  giving  information.) 

X. 

"Level" 

Target  is  at  your  altitude  or 
I am  at  assigned  altitude. 

y • 

"Liner " 

Fly  at  speed  giving  maximum 
cruising  range. 

z . 

"M.  A." 

Mission  accomplished. 

aa. 

"MAY  DAY" 

Distress  call. 

bb . 

"M.  I." 

Missed  intercept  [for  AIM 
firing,  missile  was  not  fired) . 

cc . 

"Music" 

Electronic  jamming. 

dd . 

"Nancy" 

Airborne  infra-red  equipment. 

ee. 

"No  Joy" 

Cannot  find  target. 

ff  . 

"On  the  Deck" 

At  minimum  altitude. 

gg- 

"Oranges  Sour" 

Weather  is  unsuitable  for 
aircraft  mission. 

hh. 

"Oranges  Sweet" 

Weather  is  suitable  for  aircraft 
mission. 

1':.  . 

"Orbit" 

Circle . 

■>  j • 

"Pancake" 

Land,  refuel,  re-arm. 
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TABLE  VII 

OPERATIONAL  BREVITY  CODE  (CONTINUED) 


WORD 

MEANING 

kk. 

"Parrot" 

TFF/STF. 

11. 

"Pigeons" 

The  magnetic  bearing  and  distance 
to  home  base. 

mm. 

"Popeye" 

In  clouds  or  area  of  reduced 
visibility . 

nn . 

" Rain" 

Chaff . 

oo. 

"Rat" 

"Rat  Fink" 

Enemy  fighter.  Enemy  bomber. 

PP- 

"Reno" 

Break  out  between  targets. 

qq. 

"Saunter" 

Fly  at  best  endurance. 

rr . 

"Skip  it" 

Do  not  attack/cease  attack  or 
cease  intercept  and  turn  to 
breakaway  heading.  (For  AIM 
firing  - Break  off  attack  and 
SAFE  armament  switches) . 

ss . 

"Sour " 

Equipment  indicated  in 
operating  at  reduced  efficiency. 

tt . 

"Splashed" 

Target  is  shot  down. 

uu . 

"Steer " 

Set  magnetic  heading  indicated. 

vv. 

"Steady " 

On  prescribed  heading. 

ww. 

* 

"Stranger" 

Unidentified  aircraft.  (Air- 
crew will  acknowledge  with  call 
sign  and  either  "Contact", 
"Tallyho",  or  "No  Joy"). 

XX. 

"Strangle" 

Switch  off  equipment  indicated. 

yy. 

"Sweet" 

Equipment  indicated  is 
operating  efficiently. 

zz . 

"Tallyho" 

Aircraft  sighted. 

aaa. 

"Tied  On" 

Radar  contact  established  for 
in- trail  formaiton. 
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TABLE  VLI 

OPERATIONAL  BREVITY  CODE  (CONTINUED) 


WORD 

MEANING 

bbb . 

"Vector" 

Alter  heading  to  magnetic 
heading  indicated. 

ccc . 

"Visual" 

Visual  contact. 

ddd .- 

"Weapon" 

Airbourne  intercept  radar/ 
ground  radar. 

eee . 

"What  Luck?" 

What  has  been  the  result  of 
assigned  mission? 

fff  . 

"What  State?" 

Report  amount  of  fuel  (Tape 
over  counter). 

In  summary,  the  performance  changes  of  the  vehicle  as  a 
function  of  communicating  define  the  end  goal  of  communicating, 
and  define  the  logical  link  between  auditory  data  and  system  or 
mission  performance  data. 

Candidate  Communications  Data  System 

A computer  assisted,  manual  auditory  data  processing  system 
is  envisioned.  The  method  assumes  that  "expert"  personnel  will 
participate  during  initial  system  development  research  to  generate 
unambiguous  rules  of  data  processing  personnel  who  will  operate 
the  system.  It  is  foreseen  that  multiple  passes  of  properly 
synchronized  audio  and  parameter  recordings  may  be  required  as 
a function  of  the  kind  and  amount  of  data  that  are  to  be  ex- 
tracted. While  listening  to  and  observing  synchronized  audio- 
visual, or  audio-parameter  recordings,  the  data  processor  enter 
events  into  the  computer  using  known  formats  and  structures. 

Such  events  will  be  the  time  that  maneuvers  start,  what  maneuvers 
start,  what  maneuver  is  requested,  and  measures  of  timing,  brevity, 
etc.,  that  have  been  outlined. 

Three  problem  areas  with  auditory  data  have  been  defined, 

(1)  identification,  (2)  synchronization  and  C3)  data  reduction. 

Identification.  In  the  milleau  of  the  communications 
environment  that  occur  during  training,  in  the  simulator  and 
during  combat,  it  is  mandatory  that  the  audio  channel (s)  provide 
a means  of  clearly  identifying  who  is  talking.  The  sensors 
might  have  to  employ  voice  key  circuitry  to  trigger  a digital 
signal  that  indicates  which  crewmember  is  talking  and  which 
channel  (ICS  or  UHF)  he  is  talking  on.  As  a side  benefit,  these 
data  can  be  used  as  a direct  measure  of  jamming. 

Synchronization.  Audio  data  must  be  properly  synchronized 
with  all  other  data  media  such  as  video  or  aircraft  or  sub- 
system parameter  recording.  An  auditory  functional  data  pro- 
cessing flowchart  (Figure  12}  shows  five  possible  sources  of 
auditory  data.  Because  of  the  operations  involved  with  syn- 
chronizing separately  recorded  audio  with  either  video  or 
parameter  recording,  it  is  clear  that  audio  should  be  synchro- 
nized with  either  video  or  parameter  recording  during  acquisition. 
Selection  of  the  video  with  voice  track  would  be  of  most  benefit 
to  the  immediate  training  application,  although  there  may  be 
other  reasons  to  select  the  audio-parameter  recording  method. 
Finally,  it  is  possible  that  both  video  and  parameter  recording 
will  be  incorporated  in  the  measurement  system;  synchronization 
between  the  two  must  be  achieved  if  they  contain  related  data. 

Such  synchronization  should  occur  during  acquisition,  if  possible. 

Data  reduction.  At  least  two  methods  of  reducing  auditory 
data  can  be  visualized.  The  first  would  require  playback  of  the 
data  by  instructor  personnel  who,  are  qualified  to  make  judgments 
on  the  adequacy  of  the  verbal  interchange.  Scoresheets  could 
be  developed  for  instructors  to  "grade"  each  event  in  terms  of 
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the  auditory  measurement  categories  previously  developed. 
These  scores  could  be  entered  into  the  computer  data  base 
along  with  the  parameter  data.  The  second  method  is  an  out- 
growth of  the  first. 


The  second  method  assumes  that  as  a consequence  of  meas- 
urement development  studies,  research  personnel  and  instructor 
personnel  could  define  the  rules  for  auditory  data  reduction 
well  enough  that  data  processing  personnel  could  monitor  com- 
munications and  enter  required  data  into  a computer.  There 
are  many  possible  schemes;  however,  one  candidate  is  discussed. 


A candidate  audio  data  reduction  structure  is  shown  in 
Table  VIII  which  related  the  candidate  measures  with  the  can- 
didate methods  of  acquiring  those  measures,  voice  key  analysis 
and  four  special  purpose  "manual"  analyses. 


1.  Voice  Key.  Assuming  that  there  must  be  voice 


key  type  of  circuitry  to  identify  who  is  talking,  the  same 
signal  can  indicate  the  time  and  length  of  each  message. 
Computer  analyses  (automatic)  of  these  signals  should  be  able 
to  provide  s tart/s  top  information  for  other  analyses  (descrip- 
tive commentary  analyses,  information  content  .analyses , and 
performance  change  analyses) . It  is  reasonable  to  assume  that 
once  the  computer  algorithms  are  improved  through  iterative 
testing,  measures  of  jamming,  length,  number  and  frequency  can 
be  provided  without  manual  intervention. 


2.  Brevity  code  analyses.  This  analysis  required  a 
separate  sampling  of  the  auditory  data  by  a Data  Processor 
specifically  trained  in  the  brevity  code  and  its  use.  The 
Processor  would  mark,  or  tally  in  the  data  computer  all 
mistakes.  The  rules,  of  course,  remain  to  be  developed. 


3.  Command  following  analyses.  For  air-to-air 
intercept,  low-level  radar  navigation,  and  radar  navigation 
bombing,  a system  is  envisioned  wherein  the  Data  Processor  has 
discrete  entry  keys  for  each  of  the  commands  listed  in  Table  V 
(Directive  Commentary) . He  would  play-back  synchronized 
system  performance  and  audio  data  and  key-in  the  specific 
commands  that  were  given.  The  computer  could  match  each  entry 
to  the  voice  key  signal  (to  remove  Data  Processor  reaction 
time).  Additionally,  for  rapidly  executing  events,  the  Data 
Processor  should  have  control  of  the  system  performance-audio 
data  storage  media  so  that  he  can  stop,  back-up  or  otherwise 
manipulate  the  data.  Following  the  identification  of  the 
command,  computer  analyses  of  the  response  to  that  command  or 
command  string  can  proceed  online  or  offline. 


4.  Descriptive  commentary  analyses.  A separate 
sampling  of  the  system-performance-auditory  data  is  envisioned 
to  determine  the  accuracy,  information  timeliness,  and  resultant 
performance  changes.  As  presently  conceived,  this  analysis 
would  be  conducted  by  a specially  trained  Data  Processor  in 
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much  the  same  way  that  the  command  following  analysis  is 
proposed.  During  playback,  a Data  Processor  using  discrete 
keys  would  identify  for  the  computer  the  descriptive  comment 
that  was  made.  The  computer  could  then  in  real-time  or  off- 
line determine  the  accuracy,  timeliness  and  performance 
changes  as  a consequence  of  the  commentary.  For  example,  if 
during  intercept  the  WSO  called  the  target  at  50  Left,  that 
information  would  be  entered,  adjusted  to  the  voice  key  start 
time,  and  a comparison  could  be  made  of  the  actual  target 
position  at  that  time  (plus  or  minue  a reasonable  tolerance) 
to  determine  accuracy.  If  during  ground  attack  the  WSO  called 
the  altitude  at  10,000-ft.,  that  information  would  be  entered 
into  the  computer,  adjusted  to  the  voice  key  start  time,  and 
a comparison  made  of  altitude.  Much  of  the  information  change 
between  the  crewmembers  falls  into  this  analysis  category 
from  Transition  through  Ground  Attack. 

5.  Information  content.  Finally,  a separate 


analysis  is  envisioned  to  derive  information  content  for  each 
message.  While  this  analysis  is  to  be  more  fully  developed, 
it  appears  that  rules  can  be  constructed  to  define  a logical 
information  unit,  and  the  content  of  each  transmission  should 
be  examined  to  determine  the  number  of  information  units. 


It  is  obvious  that  this  candidate  data  reduction  scheme 
can  generate  a staggering  amount  of  data.  Certainly  utility 
analyses  will  have  to  reduce  this  scheme  to  a practical  one. 
It  is  equally  possible,  however,  that  structuring  a system  to 
do  these  kinds  of  analyses  will  have  great  general  utility, 
and  for  any  one  study  judicious  scoping  and  sampling  can 
reduce  the  problem  of  too  much  data. 


V.  SUMMARY 


Better  methods  of  crew  interaction  must  be  discovered 
and  developed;  the  best  must  be  identified.  Training  methods 
can  then  be  produced,  given  sufficient  definition  of  the 
behavioral  objectives  which  must  be  reached.  In  short, 
research  is  needed  to  resolve  crew  training  and  measurement 
problems.  Some  data  are  needed  now  to  carry  the  current 
analysis  further.  In  turn,  measurement  tools  are  needed  to 
produce  such  data.  The  usual  dilemma  is  with  us:  If  the 

nature  of  crew  performance  were  thoroughly  understood, 
specification  of  measurement  would  be  straightforward; 
however,  measurement  is  needed  to  promote  greater  understand- 
ing of  the  problems.  Some  tools  are  necessary,  therefore,  to 
promote  further  knowledge  of  crew  interactions. 

Tools  for  research  can  be  specified.  Total  crew-system 
performance  measurement  will  reflect  the  contributions  of 
each  of  the  crewmembers  to  the  success/failure  of  the  mission. 
The  major  inputs  and  outputs  of  each  crewmember  is  reflected 
in  this  set  of  measures,  except  for  the  interactions  between 
each  other.  These  interactions  may  be  described  in  terms  of 
specific  bits  of  information  gleaned  from  their  verbal 
communications.  Further  data  may  be  collected  from  the  pre- 
mission briefings  and  special  post-mission  critiques  and 
interviews . 


One  of  the  main  difficulties  in  performing  detailed 
analyses  of  crew  interactions  is  the  lack  of  specificity  in 
stating  requirements  for  crew  relationships.  Crewmembers  are 
trained  to  perform  their  individual  duties.  They  then  develop 
methods  of  coordinating  with  each  other,  if  ever  given 
sufficient  opportunity  to  work  with  the  same  people.  The 
result  is  that  crew  coordination  is  not  always  developed,  and, 
where  it  is  developed,  the  methods  are  nonstandard.  Since 
crew  interaction  techniques  are  nonstandard,  and  specific 
techniques  are  not  trained,  measurement  of  crew  interaction 
cannot  be  explicitly  defined  in  most  cases. 

A further  difficulty  in  analyzing  crew  interactions  is 
the  degree  to  which  the  performance  of  each  crewmember  is 
dependent  on  the  performance  of  the  others.  For  example,  in 
an  air  drop,  the  navigator  uses  reported  winds  to  compute  the 
CARP,  he  indicates  a ground  track  for  the  pilot  to  maintain 
and  times  the  release  (which  is  physically  performed  by  the 
copilot).  It  may  be  seen  that  winds,  distance,  timing,  and 
response  times  all  become  involved  in  the  error  equation. 
Unless  a gross  error  is  evident,  it  may  not  be  possible  to 
determine  all  the  sources  of  error.  Without  such  feedback, 
it  is  difficult  for  the  crew  to  understand  where  they  must 
improve . 
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The  collection  of  these  data  will  involve  equipment  for 
recording  aircraft  signals,  visual  information  from  outside 
the  aircraft  and  the  radar  screens,  and  auditory  information 
from  the  interphone  communications . To  allow  relating 
information  of  any  given  type  to  any  other  piece  of  informa- 
tion, these  data  should  be  combined  into  a common  data  base 
format.  It  is  assumed  that  digital  computer  processing  will 
be  needed  to  handle  the  large  volumes  of  data  which  are 
anticipated.  A method  for  processing  auditory  information  is 
developed  in  this  paper  since  this  information  is  so  important 
to  the  problem  of  crew  interaction  measurement.  However,  a 
method  for  processing  data  of  auditory,  visual,  or  time- 
varying  parameters,  must  be  developed  to  cope  with  the  entire 
measurement  problem. 


